Modular networks emerge from multiconstraint optimization 
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Modular structure is ubiquitous among complex networks. We note that most such systems are 
subject to multiple structural and functional constraints, e.g., minimizing the average path length 
and the total number of links, while maximizing robustness against perturbations in node activity. 
We show that the optimal networks satisfying these three constraints are characterized by the 
existence of multiple subnetworks (modules) sparsely connected to each other. In addition, these 
modules have distinct hubs resulting in an overall heterogeneous degree distribution. 
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Complex networks have recently become a focus of sci- 
entific attention, with many natural, social and techno- 
logical networks seen to share certain universal structural 
features [3, 0| ■ These networks often exhibit topological 
characteristics that are far from random. For instance, 
they show a significant presence of hubs, i.e., nodes with 
large degree or number of connections to other nodes. 
Indeed, hubs are crucial for linking the nodes in real net- 
works, which have extremely sparse connectivity, with 
the probability of connection between any pair of nodes, 
C, varying between 10 _1 and — 1CP 8 [1]. By contrast, 
random networks with such small C are almost always 
disconnected. The hubs also lead to the "small-world" 
effect Q by reducing the average path length of the net- 
work. Another property observed in many networks is 
the existence of a modular structure. We define a net- 
work to be modular if it exhibits significantly more in- 
tramodular connections compared to intermodular con- 
nections. Such networks can be decomposed into distinct 
subnetworks or modules by removing a few links. Mod- 
ular networks observed in empirical studies span a wide 
range from cellular networks involved in metabolism and 
signalling 0, to cortical networks social networks [(|, 
food webs [7j and the internet Q . Many of these networks 
also exhibit large number of hubs, which often have the 
role of interconnecting different modules 0] . 

The majority of previous studies on modular networks 
have been concerned with methods to identify community 
structure [10( . There have been relatively few attempts to 
explain the potentially more interesting question of how 
and why modularity emerges in complex networks. Most 
such attempts are based on the notion of evolutionary 
pressure, where a system is driven by the need for adapt- 
ing to a changing environment (ill . H^ |. However, such 
explanations involve complicated adaptive mechanisms, 
in which the environment itself is assumed to change in a 
modular fashion. Further, adaptation might lead to de- 
crease in connectivity through biased selection of sparse 
networks, which eventually results in disruption of the 
network with the modules being isolated nodes or 
disconnected parts [l3j]. More recently, a social network 
model has shown the emergence of isolated communities 
through the rearrangement of links to form groups with 
homogeneous opinion [l4| . 



A crucial limitation of these above studies is that they 
almost always focus on a single performance parameter. 
However, in reality, most networks have to optimize be- 
tween several, often conflicting, constraints. While struc- 
tural constraints, such as path length, had been the focus 
of initial work by network researchers, there has been a 
growing realization that most networks have dynamics 
associated with their nodes [l5j]. The robustness of net- 
work behavior is often vital to the efficient functioning of 
many systems, and also imposes an important constraint 
on networks. Therefore, the role played by dynamical 
considerations in determining the topological properties 
of a network is a challenging and important question that 
opens up new possibilities for explaining observed fea- 
tures of complex networks [IB]. In this letter, we propose 
a simple mechanism for the emergence of modularity in 
networks as an optimal solution for satisfying a minimal 
set of structural and functional constraints. These essen- 
tially involve (i) reducing the average path length, £, of a 
network by (ii) using a minimum number of total links, L, 
while (iii) decreasing the instability of dynamical states 
associated with the network. 

We investigate the dynamical stability of a network 
composed of N nodes, which are self regulating when iso- 
lated, by measuring the growth rate of a small perturba- 
tion x about an equilibrium state of the network dynam- 
ics. Although the system can be nonlinear in general, the 
dynamics of such perturbations are described by a linear 
system of coupled differential equations Xi = Jij x j- 
The stability of the equilibrium is then determined by 
the largest real part A max of the eigenvalues for the ma- 
trix J representing the interactions among the nodes. 
The perturbation decays if A max < 0, and increases oth- 
erwise, at a rate proportional to |A max |. Thus, mini- 
mizing X m ax makes the equilibrium less unstable, which 
is important for many systems including ecological net- 
works [ri| . Here J a — —1 V« such that we only con- 
sider instability induced through network interactions. 
The off-diagonal matrix elements Jij(^ AijWij) include 
information about both the topological structure of the 
network, given by the adjacency matrix A (Ay is I, if 
nodes i, j are connected, and 0, otherwise; An = Vz), 
as well as, the distribution of interaction strengths W%j 
between nodes. In our simulations, Wy has a Gaussian 



distribution with zero mean and variance a 2 ; however, 
a nonzero mean does not qualitatively change our re- 
sults. For an Erdos-Renyi (ER) random network, J is 
a sparse random matrix, with A max ~ v NCa 2 — 1, ac- 
cording to the May-Wigner theorem [T3|. Therefore, in- 
creasing the system size N, connectivity C or interaction 
strength tr, results in instability of the network. This re- 
sult has been shown to be remarkably robust with respect 
to various generalizations [l8j |. Further, for uniform cou- 
pling strength, X max is inversely related to the epidemic 
propagation threshold for the network [l9l |. and hence, 
minimizing X max also makes the network more robust 
against spreading of infection. 

Networks are also subject to certain structural con- 
straints. One of them is the need to save resources, man- 
ifested in minimizing link cost, i.e., the cost involved in 
building and maintaining each link in a network [2C| . 
This results in the network having a small total num- 
ber of links, L. However, such a procedure runs counter 
to another important consideration of reducing the av- 
erage path length £, which improves the network effi- 
ciency by increasing communication speed among the 
nodes [21| . The conflict between these two criteria can be 
illustrated through the example of airline transportation 
networks. Although, fastest communication (i.e., small 
£) will be achieved if every airport is connected to every 
other through direct flights, such a system is prohibitively 
expensive as every route involves some cost in maintain- 
ing it. In reality, therefore, one observes the existence of 
airline hubs, which act as transit points for passengers 
arriving from and going to other airports. 

For ER random networks, although £ is low, L is high 
because of the requirement to ensure that the network is 
connected: L > N\nN 22]. Introducing the constraint 
of link cost (i.e., minimizing L) while requiring low aver- 
age path length £, leads to a starlike connection topology 
(Fig. HP). A star network has a single hub to which all 
other nodes are connected, there being no other links. 
Its average degree (k) w 2 is non extensive with sys- 
tem size, and is much smaller than a connected random 
network, where (k) ~ In N. However, such starlike net- 
works are extremely unstable with respect to dynamical 
perturbations in the activity of their nodes. The prob- 
ability of dynamical instability in random networks in- 
creases only with average degree (A max ~ \J (k), since 
(k) = NC), while for star networks it increases with 
the largest degree, and hence the size of the network 
itself (A max ~ V~N)- To extend this for the case of 
weighted networks we look at the largest eigenvalue of 

J, X max = — 1 + Jy^i JuJn, the hub being labeled 
as node 1. The stability of the weighted star network is 
governed by JuJn, which is the displacement due 

to a 1-dimensional random walk of N — 1 steps whose 
lengths are products of pairs of random numbers chosen 
from a Normal (0, a 2 ) distribution. 

To obtain networks which satisfy the dynamical as well 
as the structural constraints we perform optimization us- 
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FIG. 1: The optimized network structures for a system with 
N = 64 nodes and L = N — 1, at different values of a: (A) 0.4, 
(B) 0.775 and (C) 1. For a — the optimal network is a 1-dim 
chain. (Bottom) The modularity Q s of the optimized network 
for different a, when each module is a community defined in 
the strong sense. The transition to star configuration occurs 
around a ~ 0.8, as observed in the variation of degree entropy 
H with a. 

ing simulated annealing, with a network having N nodes 
and N — 1 unweighted links (the smallest number that 
keeps the network connected). Having fixed L, the en- 
ergy function to be minimized is defined as 

E(a) = a£ + (1 - a)A maX! 

where the parameter a G [0,1] denotes the relative im- 
portance of the path length constraint over the condition 
for reducing dynamical instability. Rewiring is attempted 
at each step and is (i) rejected if the updated network is 
disconnected, (ii) accepted if 5E = E fma i - E miUa i < 0, 
and (iii) if SE > 0, then accepted with probability 
p — exp(—SE/T), where T is the "temperature". The 
initial temperature was chosen in such a way that en- 
ergetically unfavorable moves had 80% chance of being 
accepted. After each monte carlo step (N updates) the 
temperature was reduced by 1% and iterated till there 
was no change in the energy for 20 successive monte carlo 
steps. For each value of a, the optimized network with 
lowest E was obtained from 100 realizations. 

As can be seen from Fig. [U modularity emerges when 
the system tries to satisfy the twin constraints of mini- 
mizing £ as well as A max . When a is very high (~ 0.8) 
such that the instability criterion becomes less impor- 
tant, the system shows a transition to a starlike config- 
uration with a single hub. However, as a is decreased, 
the instability of the hub makes the star network less 
preferable and for intermediate values of a, the optimal 
network gets divided into modules, as seen from the mea- 
sure of network modularity, Q [23]. This is defined as 
Q = ^ S [{L S / L) — (d s /2L) 2 ], where L s is the number 
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of links between nodes within a module s, and d s is the 
sum of the degrees of the nodes in s. To obtain a robust 
partitioning of the network, we consider modules to be 
communities defined in the strong sense, i.e., each node 
i belonging to a community has more connections with 
nodes within the community than with the rest of the 
network [24j . The resulting modularity measure Q s is 
high for a modular network, whereas for homogeneous, 
as well as, for starlike networks, Q s — 0. To determine 
the communities, we (1) compute the betweenness mea- 
sure for all edges and remove the one with highest score: 
(2a) if it results in splitting the network (or subnetwork) 
into communities in the strong sense, then the resulting 
Q s is computed; (2b) if not, we go back to step (1) and re- 
move the edge with the next highest score. The process 
is carried out iteratively until all edges of the network 
have been considered. Note that, in step (2a), checking 
whether the splitting results in communities in the strong 
sense is considered with respect to the full network. We 
verified these results by also calculating Q s with the net- 
work modules determined through stochastic extremal 
optimization (25j. The transition between modular and 
star structures is further emphasised in the behavior of 
the degree entropy, H = — ^2 k pkhipk, where pk is the 
probability of a node having degree k. The emergence of 
a dominant hub at a critical value of a is marked by H 
reducing to a low value. 

To understand why modular networks emerge on si- 
multaneous optimization of structural and functional 
constraints we look at the change in stability that occurs 
when a star network is split into m modules, the modules 
being connected through links between their hubs. The 
largest eigenvalue for the entire system of N nodes is the 
same as that for each isolated module, A max ~ \jN/m, 
as the additional effect of the few intermodular links is 
negligible. At the same time, the increase in the average 
path length I with m is almost insignificant. Therefore, 
by dividing the network into a connected set of small 
modules, each of which is a star subnetwork, the insta- 
bility of the entire network decreases significantly while 
still satisfying the structural constraints. 

The above results were obtained for a specific value of 
L (= N — 1). We now relax the constraint on link cost 
and allow a larger number of links than that strictly nec- 
essary to keep the network connected. The larger L is 
manifested as random links between nonhub nodes, re- 
sulting in higher clustering within the network. Even for 
such clustered star networks, A max increases with size as 
y/N, and therefore, their instability is reduced by impos- 
ing a modular structure (Fig. [5]) . The effect of increasing 
the number of modules, m, on the dynamical stability of 
a network can be observed from the stability-instability 
transition that occurs on increasing the network param- 
eter a keeping N, C fixed. The critical value at which 
the transition to instability occurs, o~ c , increases with m 
(Fig. [2j inset) while £ does not change significantly. This 
signifies that even for large L, networks satisfy the struc- 
tural and functional constraints by adopting a modular 
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FIG. 2: Probability distribution of A max for a clustered star 
network (N — 256, L = 15N) with different numbers of 
modules, m. Modules of equal size are connected by sin- 
gle link between respective hubs. Link weights W%j follow a 
Normal (0,(J 2 ) distribution with o 2 = 0.018. (Inset) Proba- 
bility of stability [P(A max < 0)] varying with o 2 . Increasing 
m results in the transition to instability occurring at higher 
a 2 , implying that network stability increases with modularity. 




FIG. 3: Probability distribution of A max for clustered star 
networks (N = 256, L = 15N) having four modules with dif- 
ferent types of intermodular connectivities (A), (B) and (C), 
which are represented schematically here. Link weights Wij 
have a Normal (0, a 2 ) distribution with a' 2 = 0.018. 



configuration. 

As L is increased, we observe that the additional links 
in the optimized network occur between modules, in pref- 
erence to, between nodes in the same module. To see why 
the network prefers the former configuration, we con- 
sider three different types of intermodular connections: 
(A) only the hub nodes of different modules are con- 
nected, (B) nonhub nodes of one module can connect 
to the hub of another module, and (C) nonhub nodes 
of different modules are connected. Arrangement (B) 
where intermodular connections that link to hubs of other 
modules actually increase the maximum degree in the 
modules, making this arrangement more unstable than 
(A). On the other hand, (C) connections between nonhub 
nodes of different modules not only decrease the instabil- 
ity (Fig. [3]), but also reduce I. As a result, the optimal 
network will always prefer this arrangement (C) of large 
number of random intermodular connections over other 
topologies for large L. 
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FIG. 4: Probability distribution of A max for random networks 
(TV = 256, L = 15JV) as a function of the number of modules, 
m, which are connected to each other by single links. Link 
weights Wij follow Normal (0,(J 2 ) distribution with a 2 — 
0.03. The inset shows the probability of stability [P(A max < 
0)] varying with a 2 . Increasing m results in transition to 
instability at lower a 2 , indicating that increasing modularity 
decreases stability for random networks. 

Our observation that both structural and dynamical 
constraints are necessary for modularity to emerge runs 
counter to the general belief that modularity necessar- 
ily follows from the requirement of robustness alone, as 
modules are thought to limit the effects of local pertur- 
bations in a network. To further demonstrate that the 
three constraints are the minimal required for a network 
to adopt a modular configuration, we remove the hub 
from a clustered star while ensuring that the network is 
still connected. This corresponds to the absence of the 
link cost constraint altogether and the optimal graph is 
now essentially a random network. To see why modu- 
larity is no longer observed in this case, we consider the 
stability of an ER random network on which a modular 
structure has been imposed. A network of N nodes is 
divided into m modules, connected to each other with a 
few intermodular links. We then consider the stability- 
instability transition of networks for increasing m, with 



the average degree, (k) kept fixed. Although from the 
May-Wigner theorem, it may be naively expected that 
o~ c ~ is constant w.r.t. m, we actually observe 

that increasing m decreases stability (Fig. 01 . This is be- 
cause when a network of size N is split into m modules, 
the stability of the entire network is decided by that of 
the most unstable module, ignoring the small additional 
effect of intermodular connections. Thus, the stability 
of the entire network is decided by randomly drawing 
m values from the distribution of A max for the modules. 
Therefore, for modular networks it is more likely that a 
positive A max will occur, than for the case of a homo- 
geneous random network of size N [26]. The decrease 
of stability with modularity for random networks shows 
that, in general, it is not necessary that modularity is 
always stabilizing and results in a robust network, as has 
sometimes been claimed [ill ]. 

In this paper we have shown that modules of intercon- 
nected nodes can arise as a result of optimizing between 
multiple structural and functional constraints. In par- 
ticular, we show that by minimizing link cost as well as 
path length, while at the same time increasing robust- 
ness to dynamical perturbations, a network will evolve 
to a configuration having multiple modules characterized 
by hubs, that are connected to each other. At the limit of 
extremely small L this results in networks with bimodal 
degree distribution, that has been previously shown to be 
robust with respect to both targeted and random removal 
of nodes [27| ■ Therefore, not only are such modular net- 
works dynamically less unstable, but they are also robust 
with respect to structural perturbations. In general, on 
allowing larger L, the optimized networks show hetero- 
geneous degree distribution that has been observed in a 
large class of networks occurring in the natural and social 
world, including those termed as scale free networks 0]. 
Our results provide a glimpse into how the topological 
structure of complex networks can be related to func- 
tional and evolutionary considerations. 

We thank R. Anishetty and S. Jain for discussions. 
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